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(54) Image controlling device and image controlling method 

(57) An image controlling device and method 
thereof is provided with superior operability when mak- 
ing selections from a menu displayed on a display 
device such as a CRT display. In the preferred embodi- 
ments of the image controlling device and method of the 
present invention, a menu is constructed by arranging a 
plurality of menu items three-dimensionally along a cyl- 
inder. A portion of these menu items is then displayed in 
such a manner that viewing is performed from the 
center of this cylinder outwards. The shifting velocity of 
the menu items is changed while all of the menu items 
are shifted in response to input signals from a controller 
operated by the user and the menu item arranged at the 
center of the picture is determined to be the selected 
menu item. When a following level exists for the 
selected menu item, this level is proceeded to and menu 
items are displayed on the display device in the same 
way. When the selected menu item does not have a fol- 
lowing level an image corresponding to this menu item 
is displayed. 













^^^^ 





EP 0 767 418 A1 



BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to an image control- 
ling device and method thereof, and more particularly 
relates to an image controlling device and method 
thereof capable of displaying a plurality of menu items 
and executing a function for allotting a selected menu 
item by a user selecting one menu item from a number 
of menu items. 

Description of the Related Art 

Graphical User Interfaces (hereinafter referred to 
as "GUI's") that are currently the most commonly used 
construct a graphically represented user interface by 
displaying menu items expressed by a bitmap (two 
dimensional data) on a display device such a CRT dis- 
play. With these kinds of GUI's, the user selects one 
menu item from a plurality of menu items arranged in a 
two dimensional plane by shifting a cursor using a key- 
board and/or a mouse, with the functions corresponding 
to this menu item then being executed by a prescribed 
program. 

For example, the menu shown in FIG. 1 is an exam- 
ple of a GUI where character data generated by a char- 
acter generator is displayed as bitmap data. With this 
kind of menu, character strings are generated for each 
of the menu items and the generated character strings 
are listed in a planar manner and displayed on the 
screen. A prescribed character is then handled as a cur- 
sor, the user shifts the cursor using a keyboard and/or 
mouse etc. and one of the menu items (character 
strings) is selected in such a manner that the function to 
be executed is selected. 

Further, with the menu shown in FIG. 2, image data 
is put to bitmap data and button-shaped menu items are 
generated, with the plurality of menu items generated 
being put side by side in a planar manner. One of these 
menu items (buttons) is then selected by the user shift- 
ing the cursor on the screen using an input device such 
as a mouse and the function to be executed is selected. 

With this kind of menu where a GUI is displayed in 
a planer manner with menu items lined-up next to each 
other, when a number of menu items which cannot be 
shown to the user collectively on the screen are to be 
displayed, first, the number of menu items which it is 
possible to display are displayed and the remaining 
menu items are displayed in a new picture by a user 
designation or displayed by scrolling down the screen 
so that all of the menu items are displayed to the user. 

When the user selects a menu item using this kind 
of method, there are cases where the picture display 
displaying the menu items changes dramatically 
between the initial picture and the new picture. Opera- 
tion can therefore become confusing if a change is not 



made to a picture whose relationship with the picture 
before changing can be easily understood, as it is nec- 
essary for the user to have an image for the relationship 
between the picture before changing and after chang- 
ing. 

Further, when the cursor is shifted and a menu item 
is selected, it is necessary for the point of view of the 
user to follow the cursor and the position of the point of 
view is therefore separated from the menu item to be 
selected. As a result, when the menu item display 
becomes small or the number of menu items becomes 
large, it is difficult for the user to understand the relation- 
ships of the positions of the cursor and the menu items 
to be selected, with this therefore putting a load on the 
operation of the user selecting a menu item. 

When a desired menu item is searched for with 
these kinds of two-dimensional (planar) GUI's, when 
displaying is carried out down to the menu item posi- 
tioned at the end of the menu and the desired menu 
item has not been found, the original image is returned 
to and the desired menu item has to once more be 
searched for in the reverse direction. 

The menu item selection operation is therefore 
complicated because an end exists to the menu. A 
menu item selection operation has therefore been con- 
sidered where a three-dimensional GUI is constructed 
in imaginary three-dimensional space so as to eliminate 
the ends of the menu, with the user then carrying out a 
menu item selection operation by freely moving within 
this three-dimensional space. 

For example, as shown in FIG. 3, virtual reality (VR) 
providing realistic reproductions in three-dimensional 
space is utilized, a metaphorical imitation of, for exam- 
ple, a building is provided within the virtual space and 
menu items are arranged about this metaphor. A user 
interface can then be considered where the user moves 
within the virtual space as though moving through real 
space and selects menu items. 

However, operativity becomes poor when the user 
selects menu items because the constructed menu 
space becomes complicated. It is also necessary to use 
an arithmetic device (central processing unit) capable of 
processing graphics at high speed because compli- 
cated graphics processing is necessary. 

SUMMARY OF THE INVENTION 

As the present invention sets out to resolve these 
kind of circumstances, it is the object of the present 
invention to provide an image displaying device and 
method thereof of superior operativity when making 
selections from a menu displayed on an image display- 
ing device. 

In order to achieve the above object, an image dis- 
playing device of the present invention is constructed in 
such a manner that in a menu having a hierarchical 
structure, a plurality of menu items are arranged along a 
closed curved surface closed in at least one direction 
with the menu image then being displayed so that it is 
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viewed from a viewpoint at the center of this curved sur- 
face. 

By arranging the menu items within this kind of 
closed curved surface closed in at least one direction, 
when the number of menu items is increased, a larger 
number of menu items are provided to the user by mak- 
ing the radius of the closed curved surface larger. Fur- 
ther, the situation of the first menu item being displayed 
is automatically returned to when the desired menu item 
cannot be found. 

Further, construction is such that when the user 
selects a menu item, all of the menu items to be pro- 
vided to the user are made to shift together and the 
menu item it is wished to select is made to be displayed 
at a prescribed position within the picture for the image 
displaying device. 

As a result, menu item selection can be carried out 
without needing a cursor. 

The construction is also such that the shifting 
speed of the menu items can be made to change in 
response to the menu item selection operation of the 
user. 

The load on the user in the menu item selection 
operation can therefore be alleviated by using this kind 
of construction. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a view showing an example of two-dimen- 
sional GUI for a related character base; 
FIG. 2 is a view showing an example of a two- 
dimensional GUI for a related bitmap base; 
FIG. 3 is a view showing an example of a related 
three-dimensional GUI; 

FIG. 4 is a view showing an example configuration 
of a VOD service system; 
FIG. 5 is a view showing an example configuration 
of an image controlling device of the present inven- 
tion; 

FIG. 6A and FIG. 6B are views showing an example 
configuration of the controller 6 of FIG. 5; 
FIG. 7 is a block diagram showing the configuration 
of the set-top box 4 of FIG. 5; 
FIG. 8 is a view showing an example of the hierar- 
chical structure of programs provided using the 
VOD service; 

FIG. 9 is a view showing all of the menu items 

occurring in the first embodiment; 

FIG. 10 is a view showing an example menu item 

display; 

FIG. 1 1 is a flowchart illustrating the operation of 
the image controlling device of the present inven- 
tion: 

FIG. 12 is a view showing an example of a picture 
displayed when a menu item is selected at the 
image controlling device of the present invention; 
FIG. 1 3 is a further view showing an example of a 
picture displayed when a menu item is selected at 
the image controlling device of the present inven- 



tion; 

FIG. 14 is another view showing an example of a 
picture displayed when a menu item is selected at 
the image controlling device of the present inven- 
s tion; 

FIG. 15 is a still further view showing an example of 
a picture displayed when a menu item is selected at 
the image controlling device of the present inven- 
tion; 

to FIG. 16 is a view showing changes in the shifting 
velocity of the menu items corresponding to opera- 
tions occurring at the controller 6; 
FIG. 17 is a view showing an example of a picture 
displayed when a menu item is selected at the 

15 image controlling device of the present invention; 

FIG. 18 is a further view showing an example of a 
picture displayed when a menu item is selected at 
the image controlling device of the present inven- 
tion; 

20 FIG. 19 is another view showing an example of a 
picture displayed when a menu item is selected at 
the image controlling device of the present inven- 
tion; 

FIG. 20 is a still further view showing an example of 
25 a picture displayed when a menu item is selected at 
the image controlling device of the present inven- 
tion; 

FIG. 21 is a view showing an example of a picture 
displayed when a menu item is selected at the 
30 image controlling device of the present invention ; 
FIG. 22 is another view showing an example of a 
picture displayed when a menu item is selected at 
the image controlling device of the present inven- 
tion; 

35 FIG. 23 is a further view showing an example of a 
picture displayed when a menu item is selected at 
the image controlling device of the present inven- 
tion; 

FIG. 24 is a still further view showing an example of 
40 a picture displayed when a menu item is selected at 
the image controlling device of the present inven- 
tion; 

FIG. 25 is a view showing all of the menu items in 
the case of providing a plurality of services in a sec- 
45 ond embodiment; and 

FIG. 26 is a view showing an example of the 
arrangement shape of menu items occurring in a 
third embodiment. 

so DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

First Embodiment 

55 FIG. 4 shows an embodiment of a structure for a 
system for a Video On Demand (VOD: Video On 
Demand) service utilizing an image control device of the 
present invention. 

A video server 1 provides various programs to 
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users. The video server 1 transmits programs via a 
transmission device 2 and a broadcast satellite 3 or pro- 
grams may be provided by wired transmission such as 
cable signal-providing or signal-providing using ground 
waves. 

A set-top box 4-1 receives the programs transmit- 
ted by the broadcast satellite 3 and displays these pro- 
gram images etc. on an image displaying device 5 in 
accordance with user operations. Similarly, a set-top 
box 4-2 receives programs provided by cable signal- 
providing or ground wave signal-providing etc. and dis- 
plays these program images etc. on the image display- 
ing device 5 in accordance with user operations. 

Further, the set-top boxes 4-1 and 4-2 send a con- 
trol signal tor controlling the video server 1 to the video 
server 1 via a communications line such as a cable, 
public line network, dedicated line or wireless line based 
on an input signal from the user. 

FIG. 5 shows an example configuration of an image 
control device of the present invention. This example 
configuration comprises a set-top box 4, image display 
device 5 and controller 6. The set-top box 4 receives 
data transmitted from the video server 1 , the user oper- 
ates the controller 6 and this data is displayed on the 
image display device 5. The set-top box 4 also sends a 
control signal for requesting information such as the 
program selected by the user to the video server 1 
based on an input signal from the controller 6 as neces- 
sary. 

FIG. 6A and 6B are views in front and side eleva- 
tion, respectively, showing an example of the configura- 
tion of the controller 6 of the embodiment of FIG. 5. The 
controller 6 is equipped with up, down, left and right but- 
tons 21 to 24, an L button 25, an R button 26, a U button 
27, a D button 28, an information button 29 and a reset 
button 30. The user then selects menu items in the 
menu displayed on the image displaying device 5 by 
operating these buttons 21 to 30. 

FIG. 7 shows an example configuration of the set- 
top box 4 (4-1 , 4-2) shown in FIG. 4 and FIG. 5. This 
embodiment is also equipped with a receiving circuit 41 . 
This receiving circuit 41 receives programs provided by 
the video server 1 and provides these programs to the 
CPU 43 via an interface 42. The CPU 43 then stores 
this data on a hard disc (HD) 46 as necessary. 

A transmitter 47 sends a control signal, inputted via 
the interface 42, for requesting program data generated 
at the CPU 43 based on an input signal inputted from 
the controller 6 to the video server 1 . 

The CPU 43 processes menu selection operations 
based on programs stored in the ROM 44 and input sig- 
nals from the controller 6. Further, three-dimensional 
coordinate space structure data changed in accompani- 
ment with the menu selection operation is updated. The 
image corresponding to the menu selection operation is 
then displayed on the image display device 5 via the 
interface 42 based on the up-dated three-dimensional 
coordinates. When the CPU 43 carries out this kind of 
processing the RAM 45 temporarily stores the programs 



and data etc. 

A dedicated CPU (for example, an LSI Logic (trade- 
mark) R3000 (trademark)) and graphics CPU (GPU: 
Graphical Processing Unit) capable of producing three- 

5 dimensional pictures in real-time operating together 
with this CPU 43 are used at this CPU 43. Alternatively, 
a CPU with graphics functions added or a dedicated 
CPU capable of high-speed processing can be used as 
a single unit in place of this kind of CPU. 

10 FIG. 8 schematically shows an example of the hier- 
archical structure of programs provided by the VOD 
service. In this example, the categories for movies pro- 
vided by the VOD service are Nature, Drama, Action, 
Comedy and others, giving 30 categories, with four 

is movies 1 to 4 currently prepared within "Comedy". New 
information relating to movies listed anew in the respec- 
tive movie categories for the video server 1 is also 
added to nature, action and comedy. 

FIG. 9 shows the menu configuration of this embod- 

20 iment. This menu is provided with a plurality of hexago- 
nal menu items arranged cylindrically in such a manner 
that corresponding edges are almost parallel. These 
menu items correspond to the levels nature, drama, 
action and comedy, respectively, as shown in FIG. 8. 

25 The titles and symbols for information possessed by 
these menu items is then displayed in the center of the 
menu items using a bitmap. 

FIG. 9 shows the overall configuration of the menu. 
However, in reality, when the menu is displayed at the 

30 image display device 5, the viewpoint position is pre- 
pared in the region of the center of the cylindrical space 
so that viewing is performed from the center of the cyl- 
inder to the outside. For example, as shown in FIG. 1 0, 
a fixed number of menu items are displayed on the 

35 image display device 5 using a number which makes 
selection by the user simple. 

Further, for example, coordinate information for the 
viewpoint occurring in three-dimensional space, line of 
view direction information and angle of field of viewing 

40 information are given as information regarding the view- 
point necessary for displaying the menu on the image 
display device 5. The line of view direction information 
shows which direction from the viewpoint position the 
menu item displayed on the image display device 5 is in. 

45 The angle of field of viewing information is display 
parameters showing the whereabouts of the range of 
the menu items displayed at the image display device 5 
taking the line of view direction as the center. This infor- 
mation is stored in the RAM 45. 

so By arranging the menu items cylindrically. only a 
number of menu items which is extremely simple to 
select from is displayed. Further, because the menu 
items are displayed cylindrically, when the number of 
menu items increases, a greater number of menu items 

55 can be easily provided without the user being made 
aware of an increase in the menu items simply by 
increasing the radius of the cylinder. Moreover, as the 
cylinder is a curved surface closed in the cylindrical 
direction, when, for example, a menu item is searched 
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for in the right direction and the desired item is not 
found, the conditions of displaying the initial menu item 
are automatically returned to. This point is markedly dif- 
ferent from when the menu items are arranged in a 
plane and the end is reached, where an operation 
becomes necessary for simply returning (not search- 
ing)- 

In the embodiments above and below, a descrip- 
tions are given of menu items arranged cylindrically. 
However, the cylinder can be partitioned by the menu 
item number or a greater number, with the menu items 
then being arranged along a curved surface (polygonal 
column) closed in one direction linking these points of 
partition in a straight line. 

Further, the shape of the menu items is by no 
means limited to hexagonal shapes, and triangular 
shapes, quadrilateral shapes and pentagonal shapes 
are also possible. 

Description of Operation 

Next, the menu item selection control operation is 
described with reference to the flowchart of FIG. 1 1 and 
the image display examples of FIG. 12 to FIG. 24. 

First, when the power supply for the device is put 
on, in step S1 of FIG. 1 1 , the CPU 43 makes the image 
display device 5 display the kind of opening picture 
shown in FIG. 12 at the image displaying device 5. 
Images of entering a building are then sequentially dis- 
played in the way shown in FIG. 13 and FIG. 14. 

Next, in step S2, as shown in FIG. 15, the menu 
item for the highest level is displayed at the image dis- 
play device 5. When this menu item has new informa- 
tion occurring in the VOD service, i.e. when there is a 
new information level at the lower information level in 
FIG. 8, the periphery of these menu items 61 is sur- 
rounded with a simultaneously-displayed image of a 
small object 62. For example, the existence of new infor- 
mation within the menu items MUSIC and NATURE can 
be shown as in FIG. 15 by using the metaphor of the 
movement of creatures such as birds or insects etc. 
gathering about flowers or food. 

In this way, when new information has been added 
to the menu item, an image of a prescribed object is dis- 
played moving about the periphery of the menu item 
which has had new information added. The user can 
therefore easily comprehend that new information has 
been added to the menu item. The operativity when the 
user selects the menu item can therefore be increased. 

Then, in step S3, the user operates the controller 6 
and selects one menu item from the menu. At this time, 
the user operates the left and right buttons 23 and 24 
(fine operations) or the L and R buttons 25 and 26 (large 
scale operations) so as to rotate the cylinder (all of the 
menu items) shown in FIG. 9 to the right or left to a small 
or large extent and sequentially show the menu items 
on the screen of the image displaying device 5. 

In this embodiment, the construction is such that 
the velocity of shifting the menu items is changed in the 



way shown in FIG. 16 in response to the time of the user 
pressing the operation buttons 23 to 26 for shifting the 
menu items. In this way, when the operation buttons 23 
to 26 are repeatedly pushed on and off, the shifting 
5 velocity can be changed smoothly without dramatic 
changes in the shifting speed ol the menu items occur- 
ring. As a result, the menu is shifted using an operation 
suited to peoples senses which is not incompatible with 
the user. 

10 As shown in FIG. 16, when the operation buttons 23 
to 26 for menu item shifting are pressed, first, the shift- 
ing velocity for the menu items is increased at a pre- 
scribed acceleration. When the prescribed velocity is 
then reached, the shifting of the menu items continues 

is at this velocity. When an operation button is then 
released, the shifting velocity decreases at a prescribed 
acceleration (deceleration) and then stops. When the 
same operation button is then pressed again during 
decreasing of the shifting velocity, the shifting velocity 

20 will again increase. When the prescribed velocity is then 
reached, the shifting continues at this velocity. When the 
operation button is then released, the shifting velocity 
falls until finally the menu items come to a halt. 

The left and right buttons 23 and 24 are for fine- 

25 shifting the menu items and the L and R buttons 25 and 
26 are for dramatically shifting the menu items. This 
shifting velocity at the time of acceleration and fixed 
velocity are therefore made to be different for the left 
and right buttons 23 and 24 and the L and R buttons 25 

30 and 26. For example, the values for the shifting velocity 
at the time of acceleration and fixed velocities at the L 
and R buttons 25 and 26 are set to be greater at the L 
and R buttons 25 and 26 than at the left and righl but- 
tons 23 and 24. 

35 Further, as the left and right buttons 23 and 24 are 
used in the fine-shifting of the menu items and the user 
can therefore accurately control rotation of the menu, 
rotation of the menu can also be made to stop when the 
left and right buttons 23 and 24 are released. 

40 The rate of change of velocity (acceleration or 
deceleration) during the acceleration and deceleration 
in FIG. 16 is fixed but can be set to be changed in a 
complicated manner so that the user can make selec- 
tions as he or she pleases. 

45 The load placed on the user in the operation of 
selecting the menu items can therefore be alleviated by 
changing the shifting velocity of the menu items in 
response to the user menu item selection operations. 
In this way, the user makes the whole menu items 

so shift and the desired menu item is arranged in the 
center of the screen (center ol the horizontal direction), 
with the menu item is then selected (in the example in 
FIG. 15, NATURE is selected). 

In this way, when the user selects a menu item, all 

55 of the menu items that are to be shown to the user are 
shifted together and menu items are selected without it 
being necessary to use the cursor used on the GUI's of 
the related art by displaying the menu items it is wished 
to select at a prescribed position within the picture of the 
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image display device 5. The operativity at the time of 
menu item selection is therefore improved because the 
user only has to gaze at the menu item. 

The color in which the outer edge of the selected 
menu items is displayed is made to be different to that of s 
other items so that selected menu items can be more 
reliably displayed to the user and the selected menu 
items are also made to move in a different manner to 
other menu items. For example, unselected menu items 
(in this embodiment, menu items arranged outside the to 
center of the picture) are made to move up and down 
slightly so as to appear to be floating, and selected 
menu items (in this embodiment, menu items arranged 
at the center of the picture) are made to revolve in the 
left and right directions within a prescribed scope (the is 
range of the character surface displayed in the picture) 
taking the central axis of the vertical direction as a ful- 
crum. By doing this, the user can immediately distin- 
guish currently selected menu items. 

In the above, the whole of the menu items were so 
shifted but the viewpoint direction i.e. the viewpoint 
arranged at the center of the cylindrical menu for dis- 
playing at the image display device 5 can be rotated. 

In step S4, when the CPU 43 determines that the 
information button 29 has been pressed with a menu ss 
item having new information selected, step S5 is pro- 
ceeded to and a preview of this information (for exam- 
ple, a preliminary preview) is displayed in the way 
shown in FIG. 17. If the information button 29 is then 
pressed again, the original picture (FIG. 1 5) is returned 30 
to. The user can therefore just view a preview of the new 
information by performing this kind of operation. 

Next, in step S6, when it is determined that the for- 
ward button (upper button) 21 has been pressed, in step 
S7, the CPU 43 determines whether or not the selected 35 
menu item has a lower level. If so, this level (lower level) 
is proceeded to in step S8. In the case in this embodi- 
ment, NATURE has a lower level, as shown in FIG. 9, 
and this level is proceeded to in step S8. Step S2 is then 
returned to and the menu item for this level is displayed. 40 

When the forward button (upper button) 21 is 
pressed by the user and the lower level is proceeded to, 
the CPU 43 approaches the vicinity of the selected 
menu item, as shown in FIG. 18 and FIG. 19, and an 
image of a door opening and zooming-in is displayed on 45 
the image display device 5, as shown in FIG. 20. 

In related two-dimensionally represented menus, a 
flat displaying method where the hierarchical structure 
of the menu is displayed to the top and bottom or to the 
left and right of the picture is adopted. In this embodi- so 
ment, the menu is displayed in a three-dimensional 
manner. The menu is then configured so as to have a 
hierarchical structure in the depth direction (the direc- 
tion of the line-Of view of the user within three-dimen- 
sional space) in three-dimensional space. This makes 55 
the user realize "Moving toward objectives" in a natural 
way at the time of transitions between levels. 

The overall menu is given a hierarchical structure in 
such a manner that the menu items for each level, in the 



same way as for the above-mentioned uppermost level, 
as shown in FIG. 9, are arranged cylindrical^, with the 
menu items of the upper levels (previous levels) and the 
centers of the cylinders for the lower levels (following 
levels) being linked. 

When a transition is made to a lower level in step 
S8, in step S2, the CPU 43 causes the menu for the 
level after shifting to be displayed at the image display- 
ing device 5, as shown in FIG. 21 . Then, in step S3, the 
user operates the controller 6 and a further menu item 
is selected. For example, in the example in FIG. 21 , 
ALASKA is selected or, as shown in FIG. 22, the con- 
troller 6 is operated, the menu items are shifted by rotat- 
ing the cylinder and the menu item WING is selected. 

Further, when the forward button (upper button) 21 
is operated, in step S7, a determination is made as to 
whether or not the menu item WING has a lower level. 
In this example, the menu item WING does not have a 
lower level (i.e. no movies corresponding to the menu 
item WING exist) and step S12 is therefore proceeded 
to. 

In step S12, in the same way as in the case of pro- 
ceeding from the uppermost level to the next level, a 
zooming-in image of a door opening is displayed, as 
shown in FIG. 23. A control signal requesting an image 
corresponding to the menu item "WING" is then gener- 
ated by the CPU 43 for the video server 1 and this con- 
trol signal is transmitted to the video server 1 by the 
transmitter 47. After an image corresponding to the 
menu item "WING" transmitted from the video server 1 
in response to this control signal is received by the 
receiver 41, this image is made to be displayed at the 
image displaying device 5 by the CPU 43. 

Further, in step S6, when it is not determined that 
the forward button (upper button) 21 has been pressed 
and it is determined in step S9 that the reverse button 
(lower button) 22 has been pressed, step S10 is pro- 
ceeded to and a determination is made as to whether or 
not an upper level exists for the current level at this point 
in time. When an upper level exists, this level (upper 
level) is returned to in step S1 1 . When the upper level is 
returned to, the image zooms out and an image of a 
door closing is displayed. Step S2 is then returned to 
and the menu item at this level is displayed. 

When it is determined in step S10 that an upper 
level does not exist, step S3 is returned to. Namely, in 
this case, a process for modifying the menu display is 
not carried out. In step S6 and step S9, the forward but- 
ton (upper button) 21 and the reverse button (lower but- 
ton) 22 are not pressed, step S3 is returned to and a 
new menu item can be selected. 

As shown in FIG. 24, when the conditions for 
receiving a prescribed program occur at the final level, a 
control bar 81 for carrying out operations such as the 
playing-back of the displayed image is displayed when 
any of the operation buttons 21 to 27 of the controller 6 
are pressed. This control bar 81 is then hidden after a 
prescribed period of time has elapsed when images are 
being played-back so as not to hinder the playing-back 
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of images. 

When any of the buttons (81-1 to 81-7) of the con- 
trol bar 81 are selected by operating the left button 23 or 
the right button 24, and then the information button 29 is 
pressed to operate the selected button of the control bar 
81 , the processes corresponding to each of the buttons 
(81-1 to 81 -7) are carried out. When the button 81 -1 the 
furthest to the left in the drawing is pressed, the pro- 
gram is interrupted and one level above is returned to 
(or the conditions shown in FIG. 1 1 can be returned to). 
When button 81-2 is pressed, the position of the index 
previous to the image being played-back is returned to. 
When button 81-3 is pressed, high-speed reverse play- 
back occurs. Button 81-4 is operated to start and stop 
playback. 

Button 81-5 is operated at the time of high-speed 
forward playback (fast forward) and button 81-6 is oper- 
ated to proceed to the next index position for the image 
being played-back. Button 81-7 is operated for frame- 
by-frame playback. 

When the reset button 30 is pressed by the user, 
the menu item selection operation being carried out at 
this time is reset, step S1 is returned to and the selec- 
tion operation is carried out again from the beginning. 

By doing the above, the user can have the image 
displaying device 5 display the desired image by operat- 
ing the controller 6. 

As above, a menu is displayed with menu items 
having a hierarchical structure in the depth direction 
lined-up along a curved surface closed in at least one 
direction. Then, when there is shifting between levels, 
an image shifting in the depth direction is displayed. A 
method of operation is therefore realized in which users 
can easily understand operations occurring within the 
computer and the operativity when menu items are 
selected is improved. 

Second Embodiment 

A second embodiment of the image controlling 
device ol the present invention is now described using 
FIG. 25. 

In this second embodiment, the system configura- 
tion (FIG. 4) image controlling device configuration 
(FIG. 5 to FIG. 8) and the picture displaying operation 
(FIG. 10 to FIG. 24) occurring at the time of menu item 
selection are the same as the first embodiment and their 
detailed description is therefore omitted. 

The image control device of the first embodiment is 
set-up to only process VOD services but the case of 
services for a plurality of categories other than movie 
(VOD) services such as, for example, on-line shopping 
and news etc. being transmitted from a prescribed 
server can also be considered. In this kind of case, 
these services are added to the same level as the mov- 
ies shown in FIG. 8. As a menu, as shown in FIG. 25, 
the cylindrical menus described in the first embodiment 
are piled-up in the vertical direction in response to the 
number of services provided from the server. For exam- 



ple, from the top, the cylinders of FIG. 25 correspond to 
on-line shopping, movies and news services, respec- 
tively. These cylinders then each have pluralities of hex- 
agonal menu items of the kind shown in the first 

5 embodiment. 

The user uses the U-button 27 and the D-button 28 
of the controller 6 to switch-over between service cate- 
gories displayed on the image displaying device 5. For 
example, a menu item belonging to a movie service is 

70 currently displayed on the image-displaying device 5. 
When the user then wishes to shift to an on-line shop- 
ping service at the upper part of the movie cylinder, this 
can be achieved by pressing the U-button 27 of the con- 
troller 6. Further, when it is wished to shift to the news 

is service at the lower part of the movie cylinder, this shift- 
ing can be achieved by pressing the D button 28. 

In this way, cylindrical menus arranged from menu 
items running along curved surfaces closed in at least 
one direction having a hierarchical structure in the depth 

20 direction can be overlaid on top of each other. Menus in 
which every service is clearly divided can then be pro- 
vided to the user by allotting each layer to a plurality of 
services provided by the server. 

In the above a description is given of overlaying the 

25 highest menu levels for the plurality of services in the 
vertical direction. However, this menu overlaying tech- 
nology is also applicable to lower levels within each 
service, i.e. menus can be structured in such a manner 
that cylinders are arranged above and below a lower 

30 level menu linked to a menu item arranged in such a 
manner as to neighbor a certain level. For example, giv- 
ing a description using FIG. 10, the cylindrical menu 
corresponding to the lower level linking the menu items 
"COMPUTER SCIENCE", "SPORTS", "COMEDY", 

35 "MYSTERY" and "BIOGRAPHY" can be constructed in 
such a manner as to be overlaid from top to bottom in 
sequence. 

By adopting this kind of configuration, when an 
upper level is returned to from a certain menu display, 

40 shitting to a separate lower level after this is no longer 
necessary as shifting to before a menu item link posi- 
tioned directly next to an upper layer can be achieved 
using the U-button 27 and the D-button 28. 

In this kind of case, by arranging the cylindrical 

45 menu circularly (i.e. arranging a tube in a ring-shape) 
the ends of the menu can be removed by forming the 
upper level as a cylinder and a menu which is consistent 
can be provided for the user. 

However, it is preferable for menu items arranged 

so up and down as cylindrical menus not to be displayed 
on the same screen so as not to confuse the user. In this 
case, sufficiently similar results can be obtained simply 
by piling up cylindrical menus with both ends thereof 
being linked as a data structure, because the user can- 

55 not recognize the curvature in the vertical direction from 
the screen display. 



7 



13 



EP 0 767 41 8 A1 



14 



Third Embodiment 

The following is a description of a third embodiment 
of the present invention using FIG. 26. 

In this third embodiment, the system configuration 
(FIG. 4), the configuration of the image controlling 
device (FIG. 5 to FIG. 8) and the picture displaying oper- 
ation occurring at the time of menu item selection (FIG. 
10 to FIG. 24) are the same as for the first embodiment 
and their detailed description is omitted. 

In this embodiment, as shown in FIG. 26, three- 
dimensional closed curved surfaces where each sur- 
face is formed from polygons of the same or almost the 
same surface area regardless of position are used as 
the shapes arranged for the menu items with the menu 
items then being provided along these closed curved 
surfaces. The menu items are then displayed by the 
image displaying device 5 so that these items can be 
viewed at each surface from the center of the closed 
curved surface. In addition to multi-sided polyhedrons 
such as tetrahedrons (formed from triangles), hexahe- 
drons (formed from quadrangles) dodecahedrons 
(formed from hexagons) and icosahedrons (formed 
from triangles), this kind of three-dimensional shape 
can also be formed from combinations of pentagonal 
surfaces and hexahedronal surfaces, so as to give 
three-dimensional soccer-ball-type shapes. 

The degree of freedom for the shifting direction (up, 
down, left, right, inclined) for selecting menu items 
therefore becomes large by arranging the menu items 
on a polygonal body. Further, the menu items can be 
classified into a number of categories, with it then being 
possible to gather together regions displayed within the 
closed curved surface every category. 

However, when this kind of closed curved surface is 
utilized, if a sphere having the kind of rectangular sur- 
faces shown as (c) in FIG. 26 is used, the area of a dis- 
play surface (one rectangle) becomes small as the axis 
of the sphere is approached and it becomes difficult to 
display the menu items. For this reason, dosed curved 
surfaces comprising polygons having almost the same 
surface area of the kind shown as (a) in FIG. 26 are 
used. 

Claims 

1. An image controlling device for controlling display- 
ing of a menu image having a plurality of menu 
items arranged in three-dimensional space, com- 
prising: 

input means for inputting an instruction from a 
user for selecting said menu items; 
image generating means for generating said 
menu image in response to a signal from said 
input means with said menu items arranged 
along a closed curved surface closed in at least 
one direction being viewed from a viewpoint at 
the center of said closed curved surface; and 



output means for outputting said menu image 
generated by said image generating means. 

2. An image controlling device according to claim 1 , 
5 wherein said plurality of menu items has a hierar- 
chical structure linking the center of said menu 
items of upper-level and the center of said closed 
curved surface of lower level. 

w 3. An image controlling device according to claim 1 , 
wherein said closed curved surface is a polygonal 
plane surface closed in every direction. 

4. An image controlling device according to claim 3, 
15 wherein said closed curved surface is formed from 

polygons all having the same shape. 

5. An image controlling device according to claim 1 , 
wherein said plurality of menu items can be rotated 

so within said three-dimensional space taking the 
center of said closed curved surface as an axis in 
response to a signal from said input means. 

6. An image controlling device according to claim 1 , 
25 wherein a direction of viewing said menu items from 

said viewpoint at the center of said closed curved 
surface can be rotated in response to a signal from 
said input means. 

30 7. An image controlling method of controlling display- 
ing of a menu image having a plurality of menu 
items arranged in three-dimensional space, com- 
prising the steps of: 

35 inputting an instruction from a user for selecting 

said menu items; 

generating said menu image in response to 
said instruction from said user with said menu 
items arranged along a closed curved surface 
40 closed in at least one direction being viewed 

from a viewpoint at the center of said closed 
curved surface; and 
outputting said menu image. 

45 8. An image controlling method according to claim 7, 
wherein said plurality of menu items has a hierar- 
chical structure linking the center of said menu 
items of upper-level and the center of the closed 
curved surface of lower levels. 

50 

9. An image controlling method according to claim 7, 
wherein said closed curved surface is a polygonal 
plane surface closed in every direction. 

55 10. An image controlling method according to claim 9, 
wherein said closed curved surface is formed from 
polygons all having the same shape. 

11. An image controlling method according to claim 7, 



8 



BNSDOCID: <EP 0767418A1J_> 



15 



EP 0 767 418 A1 



16 



wherein said plurality of menu items are made to be 
rotated within said three-dimensional space taking 
the center of said closed curved surface as an axis 
in response to said input from said user and the 
menu image is then generated. 

12. An image controlling method according to claim 1, 
wherein a direction of viewing said menu items from 
said viewpoint at the center of said closed curved 
surface can be made to rotate in response to said 
instruction from said user. 

13. An image controlling device for controlling display- 
ing of a menu image having a plurality of menu 
items arranged in three-dimensional space, com- 
prising: 

input means for inputting an instruction from a 
user for selecting said plurality of menu items; 
controlling means for carrying out a process for 
shifting said plurality of menu items within said 
three-dimensional space in the same direction 
at the same velocity in response to a signal 
from said input means; 

selecting means for carrying out a process for 
deciding upon said menu item at a prescribed 
position as a selected menu item; and 
image generating means for generating a 
menu image on the basis of processing results 
of said controlling means and said selecting 
means. 

14. An image controlling device according to claim 13, 
wherein said selecting means decides upon said 
menu item displayed in the center of said menu 
image as said selected menu item. 

15. An image controlling device according to claim 13, 
wherein said image generating means generates 
said menu image in such a manner that said 
selected menu item becomes an image having a 
prescribed movement differing from other menu 
items. 

16. An image controlling device according to claim 13, 
wherein, when new information has been added to 
said menu item, said image generating means gen- 
erates a menu image so that a prescribed object 
moves around the periphery of said menu item to 
which said new information has been added. 

17. An image controlling device according to claim 13, 
wherein said plurality of menu items have a hierar- 
chical structure and an image expressing a transi- 
tion between levels is also generated at the time of 
transitions between levels. 

18. An image controlling method of controlling display- 
ing of a menu image having a plurality of menu 



items arranged in three-dimensional space, com- 
prising the steps of: 

inputting an instruction from a user for selecting 

5 said plurality of menu items; 

shifting said plurality of menu items within said 
three-dimensional space in the same direction 
at the same velocity in response to said instruc- 
tion from said user; 

ro deciding upon a menu item at a prescribed 

position as a selected menu item; and 
generating a menu image. 

19. An image controlling method according to claim 18, 
T5 wherein said menu item displayed in the center of 

said menu image is decided upon as said selected 
menu item. 

20. An image controlling method according to claim 1 8, 
20 wherein said menu image is generated in such a 

manner that said selected menu item becomes an 
image having a prescribed movement differing from 
other menu items. 

25 21 . An image controlling method according to claim 1 8, 
wherein, when new information has been added to 
said menu item, a menu image is generated so that 
a prescribed object moves around the periphery of 
said menu item to which said new information has 

30 been added. 

22. An image controlling method according to claim 18, 
wherein said plurality of menu items have a hierar- 
chical structure and an image expressing a transi- 

35 tion between levels is also generated at the time of 
transitions between levels. 

23. An image controlling device for controlling display- 
ing of a menu image having a plurality of menu 

40 items arranged in three-dimensional space, com- 
prising: 

input means for inputting an instruction from a 
user for selecting said plurality of menu items; 

45 controlling means for carrying out a process for 

changing a direction of a line of sight express- 
ing the direction of said menu image displayed 
in response to a signal from said input means; 
selecting means for carrying out a process for 

so deciding upon said menu item at a prescribed 

position within a visual field angle in the direc- 
tion of said line of sight as a selected menu 
item; and 

image generating means for generating a 
55 menu image on the basis of processing results 

of said controlling means and said selecting 
means. 

24. An image controlling method of controlling display- 
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ing of a menu image having a plurality of menu 
items arranged in ihree-dimensional space, com- 
prising the steps of: 

inputting an instruction from a user for selecting 5 
said plurality of menu items; 
changing a direction of a line of sight express- 
ing the direction of said menu image displayed 
in response to said instruction from said user; 
deciding upon said menu item at a prescribed ic 
position within a visual field angle in the direc- 
tion of said line of sight as a selected menu 
item; and 

generating a menu image. 

15 

25. An image controlling device for controlling display- 
ing of a menu image having a plurality of menu 
items arranged in three-dimensional space, com- 
prising: 

20 

input means for inputting an instruction from a 
user for selecting said plurality of menu hems; 
controlling means for calculating shifting veloc- 
ity from prescribed parameters in response to a 
signal from said input means, shifting said 25 
menu items in three-dimensional space at said 
shifting velocity and generating three-dimen- 
sional space information; and 
image generating means for generating said 
menu image on the basis of said three-dimen- 30 
sional information generated by said controlling 
means. 



items arranged in three-dimensional space, com- 
prising: 

input means for inputting an instruction from a 
user for selecting said plurality of menu items; 
controlling means for calculating a shifting 
velocity from prescribed parameters in 
response to a signal from said input means and 
changing at said shifting velocity a direction of 
a line of sight expressing the direction of said 
menu image displayed; and 
image generating means for generating a 
menu image on the basis of said direction of 
said line of sight. 

An image controlling method of controlling display- 
ing of a menu image having a plurality of menu 
items arranged in three-dimensional space, com- 
prising the steps of: 

inputting an instruction from a user for selecting 
said plurality of menu items; 
calculating a shifting velocity from prescribed 
parameters in response to said instruction from 
said user and changing at said shifting velocity 
a direction of a line of sight expressing the 
direction of said menu image displayed; and 
generating a menu image on the basis of said 
direction of said line of sight. 



26. An image controlling device according to claim 25, 
wherein said prescribed parameters include at least 35 
acceleration. 



27. An image controlling method of controlling display- 
ing of a menu image having a plurality of menu 
items arranged in three-dimensional space, com- 40 
prising the steps of: 

inputting an instruction from a user for selecting 
said plurality of menu items; 
calculating shifting velocity from prescribed <ts 
parameters in response to said instruction from 
said user, shifting said menu items in three- 
dimensional space at said shifting velocity and 
generating three-dimensional space informa- 
tion; and so 
generating said menu image on the basis of 
said three-dimensional information. 



28. An image controlling method according to claim 25, 
wherein said prescribed parameters include at least 55 
acceleration. 



29. An image controlling device for controlling display- 
ing of a menu image having a plurality of menu 
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